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ABSTRACT 
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some of the lines of thought which Led to this design. ]n particular* 
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control Its environment, and deal with error situations which arise. In 
addition the paper discusses the system needed to control the motion of 
the arn using the computed torque drive method, and force feedback. 
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I . INTRODUCTION 


The Jt, IJ- A. I. laboratory is iti the process of producing a small 
robot manipulation system, the ’mini-robot', The overall structure of 
this system is dominated by a division into three partsi 

a) A high power remote computer which p thinks 1 , That is, the 
computer decides on a course of action based or the in formation 
available to it. 

b) A small local computer which controls a vision system- This 
system is the basic sensor uf the mini-robot, and is used to gather 
information about the environment. This information is then sent to the 
high level system, 

o) A small local computer which controls a mechanical arm. The 
arm is the mini-robot's output device, and performs 'actions', affecting 
changes in the environment. Though it can also he used as a sense organ 
(for forces), its abilities in this regard are Very primitive. 

It should be stressed that the high power computer probably will be 
physically removed from the local Computer!*j- Further it is one of the 
basic design criteria that the bandwidth needed to communicate between 
the tWu computer system* be aS snail as passible. 

This paper is concerned with the local software associated with the 
mechanical arm. This being the case, the blab level and vision systems 
are only mentioned in passing/ However, the reader should Jceep their 
existence in nind. 

Since the mechanical arm is basically Just an output dovice t its 
control system ninlmally could be very simple and devoid of 
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'intelligence', Ail flf the icitelligen.ce could be isolatnci in the high 
level system. On the other hand, si lot of information and intelligence 
dealing with 'actions' could be placed in the arc control system so that 
the high level system could operate at a more symbolic lovel, This Is 
the approach taken here* It ts intended that the requests for action by 

the high level system will bo concise orders for complete actions like 

11 pick, up the ball", or "throw the ballf, 

THe paper is organized as follows: Section IS first makes some 
general comments about control which motivate the design decisions made 

in the rest of the paper* It then, tries to indicate what the am 

controller is capable of doing on its own, 

Section III specifically states the behaviour it was decided that 
the arm controller should exhibit. It also attempts to explain why 
particular design decisions were sade, Finally, sceneries of four 
typical am actions are given in order to make the discussion more 
concretex Electronic circuit board construction has been, chosen as a 
prototypical task, for the mini-robot, and all of the examples in this 
paper are taken from this domain, 

Sections TV-VI describe a proposed mechanical arn control system 
which exhibits the required behaviour. This is the jneat of the paper in 
that it contains the Specific details of the proposed system. However 
the reasons behind the proposed system arc vitally important as welt. 
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II. SDHE IDEAS ON CONTROL 

II.1 'REGULATE' V$ 'CONTROL' 

In this paper, "regulate 1 and 'control" are used in a special sense 
to express twp ends af a spectrum Of the degree Of 'goodness' of 
controli If A regulates E then the control A has over 3 is so complete 
absolute and immediate that it Is not thought of ns being fallible or as 
being a process, though it probably is. If A regulates E then 0 is said 
to be a ’direct effect’ of A, 

For eXtusple, a person 'regulates 1, the position of the thermostat in 
a room. In contrast, hy means of this thermostat, he 'controls’ the 
temperature of the roos. This is true even though the processes which 
allow a person to regulate the position of the thermostat are infinitely 
more complex than the process which allows the thermostat to control the 
temperature. It is not the complexity of the control process, but its 
effectiveness that is important here. 

As a second example, the thermostat mechanism regulates the 
position pf a switch- This switch iti turn regulates the on/off state of 
the furnace. finally, the on/off state of the furnace affects the 
temperature (with a large time delay). Through this sequence of 
effects* the thermostat is able to loosely control the temperature. 
This Illustrates the interesting phenomenon that as you look into a 
control mechanism, the direct effects become more primitive and farther 
removed from the goals of the mechanism. 
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1 1 .Z 'O0SERVA&L£S f 

For A to control B, A must regulate something which, through 4 
chain of effects, evantUfllly affects B. Tn addition, unless A is the 
only factor affecting B, A must fie able to observe &, or at least 
sort#thing related to B. 

Hers again, the thermostat is a good example* It was designed with 
the realization that many factors affect the temperature, and therefore 
was designed, to measure the temperature - However, in other parts of the 
control loop the designers were not SO Careful. They assumed that the 
on/off switch has complete control over the furnace and therefore the 
thermostat was not designed to monitor the furnace. Thus when the 
burner blows out, or the oil runs out, a thermostat looses control of 
the temperature, 

Qn a higher level the therttostat is only partially effective, 
because what a person really wants controlled is his comfort, not the 
temperature, KiA COdfort is only tenuously related to the temperature 
hear him., which, in turn, is only loosely related to the temperature 
hear the thermostat. .The thermostat is only partially effective because 
It cannot observe What a person really wants it to control. It has to 
settle for something only vary indirectly related. 
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Direct Effects --- -> g**, - -*> Observables 

(Of A) (by A) 


Fig. 1 Schematic of * control situation, 

Tha three key factors of o control situation are shown in ■ figure 

I . The more tenuous tho chain of affects which link them, the weaker 
the control, 

II, 3 THE MECHANICAL ARM 

Let US consider the mechanical arm control prowler! In the light of 
the above ideas, The first thing to notice is that there lire really two 
Control problems; 

a) How is the arm going to control things in its environmentT For 
example how will the arm assemble a circuit board? 

b] How will the arm controller control the arm? For example how 
will it moke the arm move- from point X to point V? 

11,3,1 ARM AS CONTROLLER 

Looking at the first problem it is not usually thought of as a 
'control* problem, This is because the connections In Fig, 1 are so 

tenuous. Firstly* the direct effects of the arm arc forces applied to 
objects in its environment and the motion of the arm through the 
environment (possibly moving soMthing}, These effects have almost no 
bearing on tho state-' of completion of a circuit board,- Only through a 
Very Complex procedure can they cause the assembly of a Circuit board.. 
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Secondly, the arm can only observe forces applied to it. such as 
contact with Other objects, and Its □tm pcsitinn. This does net enable 
the am to draw hardly any canclusions about its environment, In the 
prototype problem of circuit board construction, the general inability 
of the arm to observe its environment is overshadowed by the great 
difficulty in observing the state of completion of a circuit board- by 
any means. 

What does "observe the state of completion, of a circuit board" 
mean ? Clearly Vision is required to find OUt where nil of the 
components and other bits and pieces on the work bench ere. However 
this list of where each thing is is not a measure of the state of 
completion. There must also be a statement of what a completed circuit 
board is like, From these two things, a list of all the differences 
between the observed circuit board, and a completed one can be created. 
This difference list seers to describe the situation, but it is Still 
somewhat unsatisfactory. Not only is it cumbersome, it docs not ,answer 
the question "what should be done neKt*. The order in which the 
Components are assembled is often not Obvious but important. People 
constructing circuit boards usually follow an explicit procedure which 
says what to do when. They gauge the state of completion by how far 
they h&va gotten in the procedure, 

We see that the closest thing there is to a measure of state of 
completion is the point in the construction procedure the builder has 
ranched. Unfortunately this is not a very good measure. It allows the 
builder to talk about and deal with the states of completion that the 
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procedure causes the circuit board to pass through. However, If the 
normal course of events is disturbed and the circuit hoard is not in one 
of the expected states then this measure cannot even describe the 
situation let alone indicate what should be done about it. 

The great strength of the thermostat on the other Emiid is that it 
is prepared to deal (perhaps crudely) with any possible value of the 
temperature. 

In order to be 'Intelligent 1 , the mini-robot as a whole must have 
the ability to deal, with airiest any eventuality. It must have a 
description good enough to describe all Situations, and be able to find 
a way out of any trouble. However, as discussed in section II below, 

the arc controller probably should not have this kind nf power. To the 
extent that it is only executing plans of action, it cannot be said to 
bo in control of its environment, because it is helpless except in very 
simple error situations, 

looking at the individual steps in a circuit board construction 
procedure, things lunk math more like a control problem. Take a 
relatively complex step like "move the At resistor now it point A to 
point X". Here, due to the greater inherent simplicity, the arm can 
observe the relevant state of the world (i.e, ars position). No matt.er 
what happens, it cap sisipiy continue to reduce the distance between the 
band and the resistor (if it is not holding the resistor) nr between the 
band and point X (if it is holding the resistor). It can deal with 
everything that can happen, because not very much can happen. Note that 
if the arm drops the resistor, insurmpuntable problems arise. Without 


ARM CONTROL SYSTEM PACE B 


vision the trn cannot find the resistor in roastwable time, or bo sure 
it has found it and not the 10K resistor. 

It is Still executing a procedure ([MOYE_TO A) (PlCkJJP) (NOVE_TQ 
X) (RELEASE)), and the position In this procedure is being used as a 
measure, However , there is a key difference, The procedure is simple, 
but more importantly, it is such that any state of the system can be 
described as a point in the (parameterized) procedure. Thus the 
controller always knows what to do (i. a. finish the procedure). 

This paper is entitled 'A MECHANICAL ARM CONTROL SYSTEM", This is 
really rather ambiguous* Its meaning depends on -whether the arm is seen 
as controller or controlled. The discussion above centers on its use as 
a controller, which Is the area of greatest interest, (It should be 
noted that the rest of this paper concentrates on control corresponding 
to single steps in a procedure, rather than on the high Level control of 
the environment, which is accomplished through the production of 
appropriate procedures from the single step building blocks). Having 
SAid this. It must Still be recognized that the arm c mi nut be fl 
Controller if It is nut controlled, 

II.3.Z CONTROLLING THE ARR 

A nechsnism which is trying to control the arm can regulate the 
torque delivered by the motors at the arm's joints. What the mechanism 
is trying tn control is the arts's position, velocity, and the force it 
exerts on external objects. Fortunately the control mechanism can more 
or less directly observe the position and; force, which makes one Of the 
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1 inks in Fig. 1 very short, Unfortunately the motor torques, though 
funct ion ally related to the position etc., have □ very complex relation 
to theta. This oakes it very hard tin the sense of mathematically 
complex, not logically difficult) for a control mechanism to calculate 
how to change the torques in order to counteract an observed error. 

It is interesting to note that there ere many ways tho control 
problems could, he simplified by improving the direct effects gr 
observables available to the coutroller. For applying a force with the 
unmoving arm, the situation is already optimal. The arm controller 
observes the forge, and directly effects the torques. For motions of 
the arm, the onJlogons optimal situation would be for the Controller to 
observe, both the position and the velocity and directly effect the 
acceleration (instead of the torques). Note -that if this was the only 
mode of control then the control mechanism would be unable to control 
the force exerted by the arm en external objects- Ideally the 
controller should be able to switch hetw 0 E » thasa two methods of 
control. The situation would be almost as good if the controller could 
observe the acceleration, because instead of using huge equations. it 
could take advantage of the fact that the torque at a joint Is 
motiotonically related to the acceleration at that Joint. However it 
might still Kant to he able to use the predictive power of the 


equations, 
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III, THE BASIC CAPABILITIES OF THE ARM CONTROLLER 

HU HOU ' INTELLIGENT 1 SHOULD THE ABN CONTROL SYSTEff BE? 

The first question to he asked about the an* control system is how 
* Intelligent ' should, it be? Intelligent is a hard word to define. In 
this context the question can be rephrased osj how complex are the 
actions which the system Can reliably control, despite the possibility 
of errors and unexpected events. 

Thus there are two major hinds of 'intelligence' the system should 
have, First the system should have knowledge of many complex actions 
which can he initiated with concise commands from. the higher level 
systems. This knowledge can best be stored as procedures, 

The other type of MnleiligehCB' deals with extraordinary 
situations. What should the system do when some th in a goes wrong? Wore 
basically, whet is it possible for the system, to do based on the 
information it receives and its abilities. The arm controller cannot 
deal with situations it cannot effect or cannot detect. Thus looking at 
the direct effects* and the observables available to the local system 
indicates how much * intelligence 1 is possible. 

Through its direct effects, the am can move an object to an 
arbitrary point and orientation in its working volune, and then apply a 
force. This should allow the arm to perform tasks such as circuit hoard 
constraictioEi, 

The observables are a different matter. The arm's sense of touch 
does not give it much information- It must ■ look to the rest of the 
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mini-robot system for most Of the key information it needs. 


111.2 WHAT INFORMATION LINKS SHOULD THERE BE? 



Fig. 2 Diagram of the communication links In the 
ITlnl-Robot system. Solid fines indicate 
definite CdHTHin I cation links. Dotted 
lines indicate possible additional HsU, 

Fig. 2 shows several possible information links- the arm system 
could have with otnear components of the mini-robot system. Which cites 
Should he implemented? 

The answer to this question Is dominated by the fact that since the 
arm controller may be physically removed from the rest of the system, 
high speed eOEmunieation may not he possible. Further, the 

simplification gained by reducing the interaction with the rest of the 
system is certainly desirable, If the degradation in the arm's obiliti.es 
is not too great. At any rate, all communication with the rest of the 
system should be concise. 

With regard to the lnfornatioft needed to deal with an error 
Situation, errors SOOHl to be divided into two classes. The first class 
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rniuht be termed 'local ' errors- These are errors that are readily 
detected by the am alone {error in position, etc,} and that can be 
corrected Without regard to the rest of the environment,, or the purpose 
of the action, A local error can be corrected by nakihg provisions in 
the control procedures. 

A goad example of a local error Is a drift in position arising 
during a root ion of the arm rron point A to point B. While performing 
the motion the arm has wandered off nf its intended course, but it has 
not hit anything. To correct the error the controller need only plot a 
new course to point E. Pealing with drift and similar problems is 
clearly a minimal requirement of the system. 

The uiortf interesting class of errors, which might be termed 
'global' errors. Is typified by the following, seemingly simple* 
example. The arm strikes an obstacle. This error cannot bo fixed 
without more global considerations* The obstacle cannot be removed 

unless the Arm can determine that the obstacle is not needed where it 

y,, . 

is. The arm cannot just go around it, because the obstacle may have- 
been damaged. The arm cannot even tell this without the vision system. 
If the obstacle Was damaged, it must be fixed. 

In general if the arm system is going to be abLe to deal with 
global errors, it must be able to decide on a course of corrective 
action based on the information available to it. It is clear that if 
the arm system is going to make intelligent decisions to correct such 
problems, OVen In the Simple case above* it must have access tfr A 
Complete model of the environment f and to a model of what the overall 
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system is trying to achieve. In addition it needs to lie able to use the 
vision system for inspect ion of the environment. 

It is also clear that the arm system cannot naj ntai n cither of 
these models alone. They require inputs mainly rrom the other parts or 
the robot system, Thus very high speed communication would i>o needed on 
all of the links suggested in Fig 2. 

further, since at a higher levg-1 there must already be a program 
capable of such intelligence, why not use it? Why not take advantage of 
the wide gulf between the two error classes and not implement any of the 
dotted communication links in Fig, 2? It was decided that the most 
■Intelligent thing the local arm system could do when it encounters an 
unanticipated error is to call for ho La, trying to be specific about the 
error that happened., and about what it was trying to do- at the tirae + and 
to request further instructions from above. 

Ell.3 SOME EXAMPLE SC EWER I OS 

In order to further ClariFy the above issues, scenerios of four 
typical arm actions are given; Fur each scenario the paper indicates: 

n What information is needed to initiate ,tllrS J ' action . 

j • |V '.i o' ■ . 

2) What additional inforsation must be developed by the arm 
controller in order to perform the action, 

3) Some of the local errors the arm controller can correct itself. 

A) flame af the errors it is not expected to handle. 
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HI .3.1 HOVE TO POINT B 

This first action is perhaps the most basic am notion. The arm is 
at point A, and it is asked to move along a smooth path to point £ 
without hitting anything. Only point 3 needs to be specified in order 
to start the action. The arm controller has to do a lot of work, 

n) It has to decide On an exact path from A to B that the arm is 
capable of following without any high acceleration which would make the 
motion jerky, 

bj The system should also have song basic ideas about object 
avoidance. For instance, if A and B are both on the table, and far 
apart r then the arm controller could plan a path that comes up off of 
the table in an arc, not a path that skins over the table, Hero is a 
place that a node I of the environment would be very useful., but how much 
modal is enough and .how hard would it be to keep accurate? The problem 
can be avoided if the higher levs! programs nave a good model of the 
arm, and bow the arm controller plans trajectories. If the higher level 
concludes that A (flOVE_TQ E) command would cause the arm to hit 
something then it just needs to break the move into twq parts (HOVE_TO 
C) (KOVE_T{> E) which avoid the obstacle. It seems that the simple 
heuristic of moving up in an arc on a motion will avoid nost collisions. 

Turning to error situations, the main error the controller is 
expected to he able to deal with is the dnrt discussed above. In short 
unless the arm strikes something, the controller will get It to & one 
way or another. Note that if position B is not a possible con figuration 
of the arm, the controller will detect this through its model of the 
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actual arm h and complain to the higher level. 

The arm controller is not expected to handle the problem of 

striking something on the way to D, In general It has to appeal to 
higher authority in order to determine if the, arm has done any damage * 
It could have a criterion, such that if a collision was soft enough it 
won id assume that the object was unrtiiraaijod,. and then try to avoid it and 
continue on as though nothing had happens*! 

In this CASS the controller must be careful that it docs not go 

into an infinite motion trying to avoid an object, A particularly 

patbalogical base occurs if point 6 is in an object, 

HE, 3, Z PUSH A BLOCK ASIDE 

Hera is another rather basic notion, A block with dimensions D is 
at position A and the am is asked to push it a distance d in direction 
ft- The request must specify A, d r fl, and at least sons information 

about B* in order to start the action. 

The arm controller is going to have to figure outr 

a) How the hand, is to approach the block. In general, it should 
be moving along ft towards the center of mass of the block {point A} with 
the longeit axis, of the hand perpendicular to the motion (so that the 
block, will not rotate when contact is made with the hand,, and will move 
in direction R), 

b) It must also decide how nuch force to apply to the block. 
Again the local errors the controller can deal with are drift-like, 

a) There is drift in the motions. 
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b) In addition several problens can arise which Hire very similar 
to drift. Fur instance if the block Sticks, the arm tries a little mare 
fordftj if the block skates along it tries a little less force. Hare 
interesting, if the block slides off of the hand, and lueses contact, 
then the arm must back up 4 little move ever acid try again ( as lonr) us 
the arm due* ndt raO' e too far afield). The arm controller can deal With 
each of these problems by Simply doing what it was doing before with 
some parameters updated. 

The kind of global errors the controller cannot handle are typifiod 
by; 

a) The arm hits something,. 

b ) The block hits Something and Stops moving {there is a SUtld&n 
largo rise in force). 

c) VJhen the ana gets to A it does not find any block, (the arra 
controller must be careful not to push the wrong thing). 

111,3,3 PUTT IMb A RESISTOR'S LEADS INTO A CIRCUIT BOARD 

This is a much more cor.ple* action. Let US assume that the leads 
are already bent and cut, The arm is asked to pick up a resistor and 
insert the two leads into the proper two holes. Mere the position (and 
orientation) Of the resistor, and the positions of the holes oped to be 
specified, 

This is a task requiring considerable precision of the arm system. 
First it must pick, up the resistor vary aecuratly so that it will have a 
reasonable id0 3 of the position of the ends nf the leads. Then it must 
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move the end of one lead to the first hole and insert it- Fin-illy it 
must get the other lead in the other hole. All through this the erm 
controller must decide how fast to move, how hard to push. 

Some of the errors the -arm can handle in this action are so 
expected,, they will probably always happen. In particular, the arm Is 
probably not so precise that it can just put a lead in a hole. However, 
the arm should ba able to get the lead near the hole. (.if Lt does not, 
the lead may etid up in the wrong hole.) The arm must drag the lead over 
the hoard trying to find the hole, it should not do this for too long, 
since the hole might be missing* or plugged. In cither case the arm 
must ash for help from above, it cannot even, tell what went wrong; is 
the hole missing Or did the arm miss it? 

This whole procedure could be simplified IF the arm system could 
ask specifier questions of the vision system (such as: 'where is the end 
of the lead?"} and get a quick answer. This is the one place where it 
appears that a small increment in cormiunication could yield important 
gains in the power of the arm system. For most problems, total 
comnunication is needed end partial c a muni cat lop is not helpful, 

'Hare are a couple of other errors the arm system Could not handle 
without extensive communication: 

*1 If the arm drops the resistor it is probably not going to be 
able to find it. It might pick up the wrong thing, 

b) While trying to locate the hole, one of the lands night band, 
the arm systec probably would not even detect this, except through 
finding Itself unable to get the leads in the board. 


mn CONTROL SYSTEM PAGE 16 


This points u,p the important fact that while tho arm system is 
working, the rest of the robot system should be looking on F even if 
there Is no direct feedback so that it can detect errors tho arm would 
miss, Also the &yo must check that things were done correctly after the 
arm Is finished. 

111,6.4 TIGHTENING A NUT WITH A WRENCH 

It is possible that if the am was strong enough it would not need 
tb use a wrench to tighten a nut, but let os assune it did need one. 
There is a wrench at location A, end a bolt at location B with a nut 
already started, and partly tightened with the hand ( this is another 
difficult task.). The action is a repeated cycle of putting the wrench 
on the hut fctbis is the hard part), swinging the wrench through an arc, 
and taking the wrench off the nut, ■ The action stops when the nut is 
tight. 

To start the action the request must specify the position of the 
nut and bolt atidi of the wrench. An interesting variation would be for 
the request to- specify the slk# of the nut„ and have the arm controller 
remember where the tools are. This view looks at the tools as part of 
the arm f 

As always the arm system must develop specific trajectories for all 
of the motions involved. Here are some points of particular interest in 
this action; 

a) When the arm picks up the wrench It must pick it up in a very 
precise manner, so that it will know where the ehti of the wrench is. In 
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general the arm. system should have a good mpclel of the arm wrench 
c □ in ti 1 h at Lon , so that It pan perform taskos like putting the wrench on 
the nut easi ly . 

b} The «ve*t difficult point is patting the wrench on the nut, 
People often do this with two hands. In order to do it with one, the 
arm will have to bo able to accurately rotate the mouth of the wrench 
about the center of the nut, waiting for the wrench to slip on, 

A special tool like a socket wrench or a nut driver would simplify 
the scenario because the arm would, only have to put the wrench on the 
nut onca* 

c) Next farce feedback is used to tighten the nut by swinging the 

wrench. Tfie arc the wrench can be swung through will usually be 

constrained by obstacles, leaving a pie shaped region in which the 
wrench Can operate. This region must be at least GO degrees in size for 
a typical wrench, and should be specified in the initial request, 

dj An interesting case of local error which arises ih this tusk is 
when the wrench pups off of the nut. The arm just puts it hack oil arnJ 
continues r 

6 ) It is interesting to note that the arm cannot tell whether it 
was successful in tightening & nut, or whether the holt is cross 
threaded^ 

In all these tasks, the arm controller can only correct local 

errors which do not interact with anything else it is trying to tie, 

unless the arm has access to accurate HOdelS of what is going on. 
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IV, THE INTERNAL STRUCTURE OF THE ARK CONTROLLER 

Section II gave a basic idea of whet the Arm Controller is expected 
to do- Thii next three sections Hill describe lion these results can he 
obtained. To begin with lot us summarize What the inputs and outputs of 
the arm hardware are. 


A) Inputs frctt arm contra Her (direct effects of control lor) 
1} Motor torqmss (at each joint (0)) 

2} Joint lockers (at each Joint (G)) 

3) Hand control inputs (open Close) 
fl) Output to controller (observables) 

1} Internal sensors 

a) Joint positions (at each joint (&)) 

b) Joint velocities (maybe) 

2 ) External sensors 

a) Force sensors In wrist 

b) Touch sensors on hand 

C) Dupuis to the Environment (direct effects of arm) 

1) Motion through environment 
2 } Forces applied to objects in the -environment 
ft) Inputs from environment (external sensation) 

1) Due to contact with objects in the environment 

a) Force sensation 

b) Touch sensation 

Fig, 3 Input/outbht description of the arm hardware 


IV. 1 ASV, ACV, AND G 

Uhat the aria controller is trying to control is the output to the 
onvironment (see Fig. 3). Doe to the decision to isolate tho arm 
system, the only way the controller has of monitoring this output is 
through the arm's own sensors (apart from some possible hand-eye 
coordination}. 

Fortunately the arm's sensors aro often sufficient for observing 
• the outputs to the environment. However, there is one important point 
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which cannot he ignored. That is the question of slap and inaccuracy in 
the am. The ana controller's modal of the arn and its abilities is 
only approximate, and the sensors have limited accuracy. This Is the 
major cause of drift in the arm’s actions. This drirt can bo corrected, 
but only within certain limits, Thera is a definite upper limit %a the 
precision of control possible* 

Returning to the main discussion* as a rotational convenience, the 
ARM! STATE VECTOR (ASV) formed mainly of the sensor outputs from the urn 
to the controller (i-B. the observables) is Introduced,. 

ASV = (position, velocity, force, touch, hand, lockers e time) 

This vector contains all Of the information that the arm controller has 
about the state of the arm without getting additional information from 
the rest of the robot system. The information in the ASV is directly as 
it cooes fred the sensors. It is in the generalized coordinates 
appropriate to the arm (i-e- the Joint angles and velocitiesJ. 

Similarly the Afi. l l CONTROL VECTOR (ACV) which gathers together the 
control inputs to the am (i.e. the direct effects of the controller on 
the arm) Is introduced, 

ACV = (torques, jolht lackers, hand control;, time) 

! 

Hate that these two vectors ere not unrelated, 

■ASV(T+dT) - F(A5V(T), ACV(T), EHV(T)) 

That is, - the new state is a function of the old state, the control 
inputs, and the environment. In order to control the arm, the 
controller attempts an inversion of this relation. 

ACV(T) a G(ASV(T), A5V(T+dT), EWV(TJ) 
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Unfortunately this inversion can. only l)* partial for several reason*: 

a) As metitionad above, the controller has very little know ledge or 
the environment {EWV(T)). Therefore it continually runs the risk of 
encountering unexpected difficulties. Each command to perform nn action 
give* the minimal description of the environment that is necessary for 
the execution of the act ion, but no more, 

b) A less important problem is that & is not single valued. The 
controller must often choose between several ways of making a state 
transition. 

cj Hero unfortunately, & is not a total function, Many {in fact 
most) state transitions are net possible at all. Intuitively this is 
clear because while the ASV has IE independently varying major 
components (6 positions, 6 velocities and 6 forces), the ACV has only 6 
independently varying major components (the fc torques). Thus in general 
the controller can only control a 6^dimensional subspace of the A5V in 
one tine interval, 

d) Lastly, even hhen G is computable, It can he computed only 

' .» • ■- *( r . - 

approximately due to the great Mathematical complexity. This is another.. 

major source of drift ir the arm's actions. 

Stepping back a moment, consider that the input to the contro-llcr 
from the robot system is a high level command such as (NOVE_TO E}. While 
the input to the arm is summarized in ACVfT), This suggests a two stage 
controller, with one stage that transforms the high levol command Into 
ASVtT+dT) and the other that computes ACV(T) by using 5. 
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IV, 


TWO STAGE CONTROLLER 


HIGH LEVEL RDQ 07 5 VSTEH 
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Fig, 4 A diagram of the two stage arm controller 
showing, the inf arnation c onm ynic a t cd 

between levels. 


The belief Chat having a two stage controller will ba vary 
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convenient is based on the following assumptions -on the interactions of 
the two Stages depicted in Fig, 4, 

a) first, It is assumed that the procedural level which transforms 
a high level command into a series of states of the arm dons Piet head to 
knew how the state transitions can bo realized, 

b) Second, tt is assumed that when the dynanic level is evaluating 
G, in order to calculate how to gat from state A to state Q, it dees not 
need to ktiow why the procedural level wants to make the state transition 
or whore the arm is going next. 

It seems that in general these assumptions are valid. There are 
several clear advantages to the two stage design, 

a) The computation of G IS very complex,, and elaborate 
approximations must be used. Thus it 1* vary important to isolate the 
calculation of G in one place Where it can be done with the greatest 
possible efficiency, 

b) Tha division also makes the system clearer and nore tractable, 
Tho dynamic level can he looked at as flit emulator Which makes tho arm 
hardware look like it takes desired ASVs as inputs instead of ACVs, 
Thus from the point of view of the procedural level; the direct effects 
have boon improved, It never has to deal with the complex nqithematics 
in Ner does it ov Q r have to deal with tha generalized arm 
coordinates. It can work in coordinates suited to the action, not the 
arm, 

el Another important point involves the ^intelligence 1 of the 
mini-robot as a whole. In order to ’'understand 1 what it is doing, it 
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mil St have sene way of in utifSfl ting the inner structure of its actions. 
But hfQW far Should this decomposition be allowed to progress? 

With the two stage controller H the answer is clear. The dynamic 
level operates as a black box, the complex mathematical knowledge in it 
forever hidden from the rest of the system. The procedural level on tho 
other hand has all of Its knowledge symbolically represented in 
procedures which are Composed of named primitive procedures. 

Thus the mini-robot can introspect -down to the level of those 
primitive procedures* and no farther * This closely parallels the human, 
situation. A person Can introspect about his motions down to a curtain 
level, but no farther. For example, most people think of wiggling•thoir 
ears as a primitive action (even though it is produced by the combined 
action of many muscles), because they are powerless to control these 
muscles below a certain level, dost people can wiggle hath ears* but 
very few can wiggle just one* even though there are seperato groups of 
muscles on each side. This is because they cannot decompose the action* 
They have no 'names' for its constituents. No way to net a hold on 
them. 

dj A final point is that some time in the future, the entire 
dynamic level could he implemented in hardware, increasing its speed by 
switching to analog methods of computing G* . 
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V. THE DYNAMIC LEVEL OF THE ARM CONTROL SYSTEM 


A> 

8> 

C> 

fl) 


Outputs to the arm hardware 
1) ACV(T) the control Inputs 
Inputs from the firm hardware 
I) AJVfT) the current State of the arm 
Inputs fron the procedural level 
1) The ■dcsIfOd ASV (DA5V) at the next time Interval 
DASVH+dT} 

Outputs tg the procedural level 

1) A5VU1 

2) OELTfl(T) this is a concise statement of the 
difference between A5V(T) and BA5V(T). It is 
expected that they will not be the sans because the 
dynamic IqvqI's evaluation or & fs Only approximate, 
hod It has almost no knowledge of ENV(TK 

3) When an error condition arises ■ 

a} The procedural level fs interrupted and 
bj Passed a concise description of tlie error, 
(Note that this exactly parallels the 
Interaction of. the arm controller as a whole 
with the rest of the mini-robot system.) 


Fig. 5 Input/output description of the dynamic, level. 


V, 1 THE DA5V AND CONTROL STRATEGIES 

As mentioned above, the dynamic level cahnbt control all of tine 
variables in the ASV at once, in recognition of this,, tho format of 
DA5V(T) is designed so that the procedural level can indicate which 
components of the ASV It is really interested in, controlling. ThG DASV 
has the sane components as the ASV, but each one can bo either, 

a)- A specific number, which indicates that this component is to be 
explicitly controlled. 

b> A list (N0M IN ALCALDE, RANGE), which indicates that an error 
Should bo signaled if the component nets Outside of the interval 
(HQJflMAL VALUE +- RANGE). - - 


ARM CONTROL SYSTEM PAPE 27 


c) NIL, this indicates that the procedural levul is net concerned 
with the value of this component. 

Based on the form of the DA&V, the dynamic level uses one of the 
following basic Strategies to compute G, 

a) If the DA5V indicates that position and/or velocity is to be 
controlled, then the equations of motion for the arm (actually on 
approximation to them) are used tp compute the ACV. 

b) If the DASV indicates that force is to be controlled, then 
direct feedback is used to control it. How the motor torques effect the 
forces' sensed must also be calculated, ihls depends on the arm position 
and the point of contact, 

c) If less than a 6 dimensional set of components is specified for 
control (in particular if none are specified), then the extra fraedom of 
choice for ACVfT) IS used to kEep components Of DA5V(T) Specified as 
Intervals closer to their nominal values. An example of this is in 
pushing a block Aside, The DASV& have nO Specific components. Before 
the hand touches the block, it moves at the nominal velocity. After 
contact, if the force rises above the nominal value, then the velocity 
wilt drop. 

d) The preceding was an example Of a Situation where contol 
Strategies a) and b) had to be mixed. This is dope by applying both, 
and using the extra freedom of choice in each one to make the two 
solutions fit. For example if A positions were specified then, this 
■would fix 4 Joints, If in addition 2 forces were specified, then the Z 
remaining joints would have tg he used to create the forces. If this 
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could net be dons,, the dynacjc level would ggraplain, 

e) Kate that no attempt is nade to control the touch sensations* 
Their stats depends on EMV(T) 1 nhich is unknown to this level..' There is 
nD way that the sensors can be rasde to turn an in « short tlcae dT* The 
dynamic level just reports their value* and can be set ta cause un 
interrupt when they chance state* 

f) At the opposite extreme* the dynamic level regulates the state 
of the joint lockers and hand. Thus an error in these is never 
detected, 

V*2 THE BASIC ALGORITHM; Of THE DVJWJI1C LEVEL 

The dynamic level is activated at a discrete set or times Ti* in 
order to produce a step function approximation AtV(Ti)- to the actual 
ACVfTJ which would produce the desired action* The Ti are specified in 
the tine component or the dasvs. Ths closer toflethar they are, the 
better the approximation is* How good an approximation is needed 
depends on the precision of the action. 

At each time interval the dynamic level executes the following 
algorithm 

1} Obtain AS-VITiJ from the arm sensors, 

Zy Compute DELTA(Ti} from ASV(Ti) and DASVtm as follows: 
for each element of M5V(7i) one of three cases applies 

a) copponent absent, DELTA(Ti) = ASVCTiJ 

b) component on interval, DELTA(Tl)' - A5V(Tl) - 
(KOHlNAL_VAUJE{DASV(Ti}) )■* In addition, if ASVfTi) is 
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outside of the allowed interval then interrupt the 
procedural level and inform it of the error, 
c) component b number, fl£LTA{Ti) - ASV(Tt) ' CASVtTi) 
(note that the prohibbi 1 ity is near sere that 

CELTA!Ti) = D, oven chough this is the yoal. However, 
the dynamic level takes no action hero no matter what 
DELTA(Ti) is. Hither it waits until step fl), That 
is, no matter hew bad it did last interval, it will rjo 
on if It thinks that it can get to whore It should he 
at the next time interval. In any case, it can use 

DELTA(Tl) to improve Its approximation to 5.) 

3) get DASVfTi+L). The procedural level communicates with 
the dynamic level through a qusua of DASVs, If this queue 
is empty* the dynamic level interrupts the procedural Laval 
and requests a DASV T "he arm must he continually 
controlled. Until the dynamic level gets a DA5V It will 
continue the current ACV with possibly bed results r 

How Close the coupling between the two Levels is 
depends on the length of the queue. The procedural level 
can taka compute control by supplying the DASVs one At a 
time. Alternately the procedural level can leave the 
dynamic level alone indefinitely by putting a loop In the 
queue. 

4) Calculate ACV(.Ti3• and apply it to the arm. To do this, 
the dynamic level must first Check to See that DA$V'(T1 + 1) 
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is achievable. If not, it interrupts the procedural level 
and re^uEsts a new DASV(Ti) which is achievable r Alsu note 
that snnE subconpntdtions (such as evaluation of the 
equatiuus pf motion) ars very time consuming and will have 
to be spread over several time intervals, 

5) Wait until Ti + 1 and then go to 1), It is very important 
that the dynamic level begin its computations at tine Ti+l; 
it cannot wait Tor anything. Also the entire Computation 
must be short compared with the length of the time 
interval, or the control Will deteriorate. To this ciuK it 
is clear that the arm system as a whole will have to run as 

a set of asynchronous tasks sharing the CPU time- 

V ,J ERROR DETECTION IN THE DYNAMIC LEVEL 

Lot us take a final look at the "error detection h the dynamic level 
is doing. It Is of two types; 

a 1 The dynamic Level complains because it cannot make a requested 

state transition (step 41 ► The problem could have been caused by one of 

two things t 

1) An impossible sequence of DASVs was issued. This Should 
not occur if the procedural level Has a good enough model of the arm's 
abilities. 

2} Inaccuracies in the computation of G and, in the arn 
hardware caused the dynamic level to wander too far from the requested 


trajectory for it to recover. 
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b) The dynamic level complained. because some element of BAEV(11} 
{expressed by a range} was not consistent with AEV(Ti). Essentially 
these range elements in the DASV • are used to hold predic tion s of the 
corresponding elements In the A5V. The dynamic level simply informs- the 
procedural level iwhenever the procedural level's prediction 1^ 
Incorrect, (This basic method! of error detection was used hy Ernst). 

Since the dynumic level knows nothing shout the 1 purpose * of its 
nctionat or about ENV{T)„ it really doet not know whot is happening. It 
knows that situations of typo "a" (above) arc errors. However, it does 
rot know what the 'nooning' of a type *b n situation is. The interrupt 
mechanism is just used so that the procedural level coit roguost the 
dynamic level to bring key points of information to the attention of the 
procedural level. The procedural level .must decide what the in forum t ion 
l roeans 1 . 

For example the information that a touch sensor has changed state 
could moan "the hand just crashed into the table 1- or it could mean "the 
hand just found the capacitor'. It all depends on what is being dene. 

Ths above uachanism is probably not sufficient for all error 
detection. In addition there will probably be ’demons 1, in the 
procedural level that monitor more temple* functions Of the A5V or other 
indicators in order to detect error situations. The interrupt mechanism 
merely institutionalizes the most common kind of monitoring. 

Also One element is added to the BAEV not found id the A$V- This 
element simply causes an interrupt whenever it is present. This is used 
to synchronize the actions of the dynamic and procedural levels. In 
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particular it would he us^d to in Torn the procedural level that a 
particular phase of on action was completed. 

In summary then, the dynamic level is soon to be quite simple, 
except far the mathematical conpleMity needed to carry cut the control 
£i. 0 . computing 6}, 



ARM CONTROL SYSTEM PAfiE 33 


VI. THE PROCEDURAL LEV&L OF HIE ARM CONTROL SYSTEM 


A) Output to the dynanic leval 

1) DASV(n) the desired A5V (communicated through a 
■queue) 

0.J Inputs from the dynamic level 

1) ASV(Ti) the current stats of the arm 

£) DELTA(Ti) the summary of differences between 
ASV(Ti) and &ASV{H) 

3) Interrupts signsiting errors and key information 
detailed in Delta(fi) 

C) Inputs From the high level robot system 

1) High level commands in the form of LIRP programs 

2 ) Interrupts signalling error conditions or key 
information detected by other elqnants of the 
mihi-robot system (for anample the vision system) 

D1 Outputs to the high level robot system 

1) Signals indicating the completion of an action 
. ’£) A5V(T1) (In some high level coord inn tes) If 

requested 

3) Interrupts signalling error situations 

4) A description of any error {see V.3 below) 

Fig. & Input/Output description of the procedural level 


VI*l THE PROCEDURAL LEVEL IS A LISP SYSTEM 

The .procedural level is 3 LISP system with a Large body of built-in 
functions, These functions can be divided into throe classes : 

a) The first class consists of the basic 'Lisp functions {PROP, 
LAMBDA* COND+ etc.) plus a set of functions to imp 1 ement the multiple 
asynchronous control paths necessitated by the real-time demands on the 
system. These include functions for synchronizing eomrtunicatlon 

between, creating, and deletlhj control paths. 

In Addition, there are functions for creating end fielding 1 
interrupts (see V r £ below). 


b) The SOCOrtd group Of functions embody mathematical information 
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about the am and its capabilities. These include functions for 
tran 5 forming between coordinate systems, planning tmjnetorins , etc. 
The dynamic level can be thought of as one of these programs. These 
programs are implemented in machine code for efficiency, 

e) The last class is the most interesting 1 . It is the set of 
procedures for performing actions. These programs arc kept as lists, 
and are available for inspection by the higher levels. The commands 
sent by the high level system are either direct calls oh these 
procedures, or nnre complex procedures bu.ilt out of the functions 

already in the system. Procedures can be added, deleted or altered by 
the higher level system in order to suit its needs. Some oxamples of 
basic procedures am; 

I} FTOVEJTO B. 

£) HALT arm where it is, 

3) APPLY^FQRCE F to point A, 

4} HOVE_JN_15IRECTi(Ml R from point A until contact is made ^ith an 

object, then halt, 

$) GRASP the object between the hand's fingers (some routine 
Called by this routine must calculate the change in the inertial 

description of the arm when it picks up the object). 

Sane examples of more complex procedures that might be in the 
system if it were working la the environment of circuit board 

construction are; 

1) [WSERTJ^SISTOK at A in holes at B, 

2) START HUT at A Oh bolt at B. 
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3} SGLDER_LEAD in hole at A. 

4 ) ATWCH_TEST_PROBE Eo lead At A, 

Any action can be encoded as * procedure as Iona as it can proceed 
by dead reckoning without feedback from the rest of the system. Whether 
procedures Like 1-4 above will be done with or without visual feedback 
depends on the taste of the users, and the speed of visual processing. 

VI. Z HANDLING ERROR SITUATIONS 

It is clear how everything works as long as no errors arise. 

However* it is the error situations that are the oost interesting. 

Id format ion About errors is brought to the attention of procedures 
able to deal with them through interrupts issued by other procedures 
which have gotten into trouble. The interrupt- facility is basically a 
simple pattern-directed invocation facility with two key differences. 

a) It is assumed that only one procedure will be appropriate at a 
time. This assumption does ncit seem unreasonable in light df the simple 
kinds of errors with which the ana control system is trying to deal. 

b) Control is almost never returned to the routine issuing the 

interrupt. The issuer is usually supplanted by an updated approach to 
the problem facing the arm control system. 

The interrupt mechanism is implemented by two functions; 

a} (SIGNAL IKT ADDS CONFORMATION) Where I NT is an atom (the 

pattern ror paltern-’-directed invocation.), and ADDED_ INFORMATION is 
anything that the Signaller feels will be useful to the invoked 
procedure. 
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h) ^ON IWT PRED ACTION) ICkfv an ON is executed, it Gh-lars the 
triple {INI PRED ACTION) opi a stack. The triple is renewed from the 
stack when, the PROG the ON Was executed in 15 exited. 

Whan an interrupt is signalled, the stack is searched Tor an 
appropriate triple, A triple is appropriate if INT is thg .siirae as the 
one signalled, and RRED is true. When an appropriate triple is found* 
ACTION is evaluated in the envirtnitteut of the PECO in which the ON was 
executed. 

Here is a simple example of an action procedure using these ideas, 
(DEFUH MOVE_TO (Ej 
C PROS u 

(ON COMPLETION T (RETURN?) 

(ON UNA BL£_TQ_C0NT I NUE_?10f I ON T (GO RETRY)) 

EtETRY ( 5 ETq DA£VQ (FlAliE_TRAJECTQRY E) ) 

(SUSPEND) )) 

In the above t DASVQ is the queue of DASVs used to communicate with 
the dynamic level, COMPLETION Is the interrupt that is generated by the 
additional element of the last DA£V in the queue. 
UNABLE_TD_CQHTINUE_MGTIGM is the interrupt signalled by step d ) of the 
algorithm running in the dynaaic level,' KAR£_TKA,J£CTORY is a 
mathenatlcal routine that plans a trajectory from the present location 
to the point E. The returned queue of DASVs Is terminated by one set to 
signal COMPLETION, and one that points to itself to keep the arm 
stationery and waiting at point R, SUSPEND is a function that stops 
execution in a control path. Execution can be resumed by the action of 


ARM CONTROL S VS TEN PAGE 37 


another control path. 

The structure of tins program is typical. A proendure usually sets 
up a series of alternatives for future action r computes sons number of 
DASVs, and then suspends itself. It will later he reexcited by an 
interrupt from the dynamic level, 

V.3 A DEEPER LOOK AT ERROR SITUATIONS 

The interrupt facility is intended to give the procedural level the 
ability to deal with simple local errors* that is the errors described 
in section II as being easy enough for the arm control system to deal 
with alone, 

But what about difficult errors? How are they detected and what 
does the procedural level do about then? The Only way the procedural 
level has of observing errors is through the A$V, As long as it 
contains Values consistent with there being no errors, then no error can 
bo detected by the procedural level. As soon as the ASV fails to agree 
with the prediction of the procedural level (or a watching demon sees 
something wrong) an interrupt is issued. At this time, the ON stack is 
searched for an approriate triple. If one is found, fine. If one is 
not found, then the procedural level concludes that it cannot deal with 
the error. At this point, the high level system is Interrupted* ALse 
since it may be a long time before the high level system responds* the 
ana is told to halt where at is, end the whole am control system waits 
for a command from the high level system. 

Note that the interrupt might not have originated in the arm 


ARM CONTROL BY STEP! PAGE M 


control system, but rattier in sane Other C Ortpo n e h t of the fill n i - rob O t 
system - for instance, the Vision system might have detected soraf! thing 
which tt wished to report directly to the arm controller rather than to 
the high level system. If the ara controller does not Know what to do 
about it, It will Just reflect the interrupt up to the high level 
system. 

In summary* from, the point gf view of the procedural levels a 
difficult error Is all Interrupt for which no specific ON has been 
executedi Whenever a difficult error occurs, the procedural level ask* 
for help and waits. 

Now the important question is: how is the high level system is 
gain# to respond to an error interrupt? There are two main ways for it 
to proceed, 

a) The Clean slate approach; Kero the high level system decides 
not to try and salvage anything of the current stats of the aria control 
system. Rather jt just looks (with vision ote.) at the current state of 
the environment, and on the basis of high level pools creates uri 
entirely new procedure to Send to tfie arm control system, in order 
Correct the error and continue OP, 

b) The patch up approach: Here the high level system tries to 
patch up the partially executed procedures in the arm controller in 
order to correct the error, and then has them continue on. This has the 
advantage that partial computations are not lost- Also there is a good 
chance that similar patches can be given to similar errors even when 
they occur in the context of very different actions. The biggest 
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disadvantage of this appraoch is that the high level F;y stom must know a 
great dell of information about the 4rn control system in general,. find 
about the specific control paths currently being executed, ih order to 
RflliS a good patch. 

Also note that the Second approach 1$ not able to fin anything that 
cannot be done with the first method, The second method is just mu re 
convenient,.. further, the gale is greatest if the ongoing process is 
complex, If it is sample then the high level system miyht Just as well 
start over. 

Vhan the procedural level gets an error interrupt from the dynamic 
lovol, it could also use either the clean slate or patch tip approach. 
Mainly because a-queue of DASVs does not really contain that much, 
information, the first approach is usually used. A whole new queue of 
DAEVs is created. 

In the initial arm control system the high level system will use 
the clean slate approach. At a later data however, it will be of groat 
interest to implement constructs that will allow the-high level system 
to talk with the procedural level about its internal state of execution. 


